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THE ORGANIZED SEARCH ‘PRINCIPLE IN SYSTEMS 
2 WITH AYTOMATIC OPTIMIZATION = 
[rellewing 1s‘a translation of the article by, Cor 
. pagponding Mesiber of the Academy of Sciences USSR, 
Te Me ‘Gel! fand;..and Me Le Tsetlin, 4n Dekiacy s 


| aes ssp (reports of tne Acadeny 0 , 
. .T37, No 2, Moscow, 1961, pages 2950298] 


- . Sa many practical problems need arises to control the compiex 
‘systems with high number of degrees of freedom, The study of physic~ 
Logical processes, gach as construction of motion, enalysis of affer= 
‘ent nerves etcs, Leads to this category of problems, The attexpts to 
solve these problems by means of glassical mathematics very often 
turned out to be unsnecessivl. Even 4@ there is no difficulties ‘tO 
find an appropriate algorithm to aclve ali cases of a problea, te 
yealization of this algorithm is not always fessible due to ths gap 
‘between speed of sointion required by & problen and offered by con= 
‘temporary computing technique in real time domains a. 

tm situations Like these the eolution may be achieved by the — 
use of "Organization, vhich is a familiar pattern in physiolesy, 
particularly in naman behairier. In other words the selution is attained 
at the expense of avoiding to consider the most laborious chaotic | 
situations. Let us note, that in many occasions these disadvantageous 
chaotic situations are most probable cases in a sense of formal mathee . 
matical treatmeite . | : | cs, 

Tia paper ie an essay Ch the solution of a preblea sr, automatic 
control, namely a problem of autonatic ontinization with 4 igh number 


4a an gutomatic feedback control system which eontinuetely adapts ite 


automatically adjusting its parameters seward optimun performances We : 
will call these adaptive oF selfeaiptive systems sispiy systens with 


optimization principle based upon & special method ef organised-non= 
Local search, gaggested by Io He Gel'fend. ‘This method has tumed out | 
to be a very effective one in computing of an extrem (mindioun or | 
maximum). | : | ae 


ys Oe 


Now, let Flay, oan, a Vir eos. Fy) be the outont fimetion of 
our syater with automatic optimisation. te wil. call a group of ine 
Gepentent variables x, aera, , a operative groap of arguments, The 
values of these argumonte vary in the peosess of automatic search. 
Tho APYGURENTS Fy, ese, Fy are Laplicit system parareters, general Ly 
are functions of time, taerefore the output function aay be writtes 


dns this form : Fexs,. weghens Us... Ym} as Dixi,... Kasi}. 


We have te note, that in salfasdaptive control systems the oute 
put fonction G(a4, oes, Bp, %) asually is net given in analytdecel or 
any other eodtrete fom, 69 That the selection of necéesusry optduising 
Vaiues of operative paraneters ie an experimental. process, This fonee 
thonel, depsndanes of @ of time, which ig net known expuieatiy, leads. 
to necessity of continueus search for desired values of SYOURCNES, 
Censequentiy the speed of search is a very important factor, 4.6. 
roughly epeacing, the correction of the outynt must be accomplished 
fast enough to catch up with the fimetion before 14 is too Late te 
affect 1%. | ; : eet _ 
| 18 CiNGe wOTds, in order to keop the optimiesd outout Punetion 
‘in certain desived Limits, 4¢ 18 necessary to reach thoes autisisetoery. 
Vaiues before the Dmetion undergees a considerable change in ite 
Value, ‘ihe prociadty of ingtantenmucus value of the Ametion to its 
extremum could not be used as a criterion of the system perfornancea: 

& folloving functional sen be used instead | : 
i WO Gain g toy a. a ‘ 
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a Cam on oe : . | 
Tho fimetion “Y aay be chosen in different ways, ‘thus, for inatanee, 
with 2(6) = @ the value of this functional corresponds to so called: 
"piace of The soarsh®, whieh is found in the siaplest evetens ef auton 
Matic winimization with single operative parameter and single missin: 
of function | (Ref 1}, - | | | | 
dn the problems where it is sufficient te maintain the values — 
of @ so greater than a certain prescribed level ¢ (Minimization on the 
devel} it will be cenvanient te use a criterion obtained fron C1) with. 
the sesuection — | | : a 
y@=0 with O<C Y@=i wth oso < &) 


The automatic search may by accomplished by wezns of different KetnHods, 
which sould be divided inte three groups. | . | | 

aa ‘First group is the method of randex séarch, in which the export 
mental trials of necessary parameters are performed indsoondently one 
from another, in these cases either ali points ef the operative paras 


‘Meters space is scanned in a certain order; or these neints will be 
chosen at mondom and mot changed aa leng as values of © are still. 
satisfactory Chomecetat vrinciple, Ref 3 ond A}. Dering eontinvens . 


search by these methods, values of $ are not duproving systematically | 
Prem trial to trial, hense “the price of the ssarch!! is hagh. | 
the sacond group ia a method of local automatie search, which — 


z 


provides the analysis ef resulta of each trical in order to determine 
the values for the next. try. fo this group belong methods Like 
gradients, relaxation, most rapid descent and sowie others. Their 
common feature is lecalisn: an operative point continuously moves in 
the space of operative arguuents and the preparation of the next trial 
4s performed taking into account values of fancti ® from the previous 
trial and expanding thea in their neighbourheed. Loca search method 
‘provides the better values of in the process of search, which makes » 
4536 method superior to the method of random search - 
However, using only local sears, 2,4. im the nearest nolgnocure 
hood, this methed only plightly utilizes the specificity ef the opti~ 
mized function. With emall gradients gil leeal methods are not effie 
cient, forcing one to resort multiple change of the eperative step | 
in the direction ef motion, whics yvasuite in the considerable slowing 
down of search®, (* Besides there is givays danger of recycling of the 
search around sone dnelopt ficant "shallow sink}. | 
| Tia syatens of axtomatic optimization with leas. method of 
search have been desorbed in detell in works of Ae A. Feldbaum (Ref 
2, 5, and 6), where several shematic diagrams of these syatems are. 


Tre third group is a method of non-local search. ‘The character~ 
astic feature of this group is discontinuity of motion of the operative 
point in the parametric space, The sharply increases volusae of space . 
 peanned par unit time; as thers srises possibility te utilize the | 
specificliy ef the ceastraction of the function ©; the process of 
optimization is considerably Fastars | | 
Tre siuplost nonlocal metned is a eoxbinatdion of lecal and — 
homeostat methods, This nothod 46 often used in computational practice 
ocd is as follows: At firet a peint.at random is chosen then from it 
‘the deseent is made in accordance with & preferred local method mitil 

the cnange of the fuastion becomes: auatl, After this, another point 
at renden ia chosen and descerit is made etc. Tt24s, for instance, 
the non-local gradient mothod. | oo | 
| This method of nem~Local search possesses & demerit that after — 

each descent tho value of Gegain (and, generally speaking, considerably) 
Aneyoases: the information about function gained diving 6 loeal dessent — 

sunsequently ie not utilized. Or, accomt of the systanatic exit 4nte ths 
region of large values of and songequentiy the necessity of protracted 
use of local metheds,*the price of the search" 4e relatively highe | 

| We will new desetibe our method of noneiocal search, which we 
will call a method of the ravines, This method implies that operative 
parameters X14 eve, Xy sould ba divided into two groups, The firat 
group includes almost all the parameters and variations of those para 
moters regults 4n considerable change of @metion 6, Hence, the is 
tuning on these parameters 12 gimple and rapid, These parameters we 
will call unimportmt. The second group of variables includes small _ 
(may be 2 or 3) number of funotions of Ay, sees variations of which 
results in relatively’ mall changes of g. We w cali then essential 
variables, Naturally, the division of parameters inte two groups 13 
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the tive desendent and therefore must be accomplished autowatioaliy. 
This division of parameterd, of course, is Lmpossibie to ebtain for 
all mathematleal fwmetions. However for all practical cases (jroblems 
of agplied physics, of engineering ate.) such division, apparently, 
is always poosible te accomplish, Realising the citftLeulty of exact 
definition of these aacepts, we will nevertheless risk to call them 
here well organized fmetions. | a 
 Awtemettie search thon is going is the following way. A. Mrst 
an arciirary point Z, (Mg 1} is chosen, From this point a descent is 
gade by the gradient (it is possible, -_ ; : 
ef courss, to use ony other locus OR y 
method), This deseent better bea = ‘ f 
course one; if, fer instance the ( : 
next. step will decrease value of O habe 
Lens then 5% te 15$,-then 34 showld | we | 
‘be stopped. The feet te that as soon hy 


as.the descents by gradient ceases to ee 
have substantiel effect on the value - as | fhe, 
of &, we get inte 4 zone, weers . : i 

@ 


variables of both groups become | | A, 
equivalent; and withouws any ‘e 
notiosabie pregvegs due to essential ze 1h 
variables ve will continue te wonder . 
tvrogilarly varying the wuikeperiant Variables, As a matter of Pact, 
this is the cange of low effieleney of the locos), metaccs, 

Leh te ataume that the gradlent descent orcught us from point 
X., $9 point Aye Supsequently anotmer point Js is selected im the 
nelghbournved ov XE, bab at a distance substantially greater than the 
gracient~itep ef descent. From the point fy tho grachant cenzens 18 
made, Row wa heve to points A, and A, in a Payine end we Wial make 
the next step along the ravine, ‘The points 4&, and A, we will somect 
ey a steaichh Line, extend the lime beyond pont Ay and select & new 
point Ip on it wt a Gletance from point Ay, Which we wil Cheek. “GES 
sattigetion, Tkia chosen step for well organized fumebions LS Goh 
sidersbly greater then a gradlent-etep, The selention er the PAViNGe 


amd wo fot a polms Age Point Ay is found on tne straight line extended 
beyond dine AjeAs in s siwliar Ramer as the line A,=ky Was uaed to 
Mind « ceint Zp, end the whole process ls repeated. Points % are 


whole quare: is pexfermed principolly im 2 tone of smell walues of 
> (*tinwaver, et the exact Lecations of points dy the values of Ca 
may not te sual, due to the effect of unimportant pe yeuetecs}, With — 
adapta itselt to the course along the ravine, s that values of 
gradient descents become much ssialler than 2 value of a re snaSteprs , 
(* The solection of a ravinsestep determines qualitative character~ 
seties of tactics of the search. With » chosen ravine-Step we "go over 


& 


the htlis and round the high mountains", The ravine«stap $S27S8 as a 
scale factor). As a result "the price of search" is soneiderabLy 
‘gnalier than in local methods or previously dsssribed prinitive none~ 
eal method. ‘Prus, with aight or tes variable parameters in the 
roblent of phase analysis, "the prica of search" wild bea hundreds of 
s lower. 3 
We wikl note, that for the selection of ravine=-atep it would 
be helpful to use the fumetional (1) with Fitmetion diesen in accords 
ance with (2). ‘The length ef the ravineestep eorregronds te a certain — 
fixed value of thia functional, If the ravine-step is too smali the 
functional becomes enall and search goes Flow. ig the rvavine=step is 
very large the value of the functional imereases and the search is - 
SOUP Ia - j . 
“ne selection of a gradient for the functions of many variables 
4s ted with the necessity of fixing (n + 1) values of O and becomes 
too embersome and tedious, ‘the following method way be used here. 
Te sertain initial probability values p;, oor, Py 18 given to the 
FATLABLES Hy, eee, Myo Sulosequentiy in aeseriance with srobabliity 
Values few dixections are selected and a partial gradient is computed. 
fevending on the results of motion by a partial gradient the initial 
distribution of proosbllities is corrected, go that the adaptation of 
divection of motion toward direction of total gradisnt* takes DLRCGe 
((* Taese considerations are closaly velates te the behavior of antomata, 
which would be a tople for discussion in a separate He Le Tsetiin | 
paper), Xt hag bow mantiened above, — instead of gradients, any trial 
Of Local situations ia possible to use. tes Me 
Tt 4e iepertant te note, that for Duncticne ghaaging rapidly 
with time, the correletion hetvem two points separated by a ravine= 
step dating the shift alieng the ravine becomes gmoki: and therefore 
the ravinsenethed in this sense Ls approaching the noneloveh gradient 
nethod, Farther &nevease. of dependence of Gof time leads to decrease 
ef local correlxsion and this casa approsches the random metiod, Ih 
substance the cwrimesnethed Amoludes in it nomelodal rradioat meted 
and random search and yields essential profit in the oases wien the 
gpeed (freasenay) of aearch is creater than rete of uhange { frequency). _ 
ef fmetion ©; im ali other cases this method is Little batter than | 
gradient and random methods. A similiar situation exists also when — 
the degree of organization of fonction is dscreasade et 
“We wii nete in conclusion, that 1% seens propable to us tas 
gxistesce of connection (analogy) batwoen primitive folioweup syatens, 
motheds ef random search, local and non-local methods of automatic : 
optimization (adaptive systema), on the one hand, and construction of 
sotion of human being and animals, on the other hand. Tris thought had 
mean digoussed firet by'N. A. Semahteyn (Ref. 7}. te 
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